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ABSTRACT 


The  stochastic  stability  of  linear  systems  with  non-Gausslan  multipli- 
cative (state  dependent)  noise  is  analyzed.  The  particular  noise  processes 
considered  are  a form  of  filtered  Poisson  processes.  A technique  is 
presented  for  investigating  the  pth  moment  asymptotic  stability  of  linear 
systems  satisfying  certain  Lie-algebraic  conditions.  Several  examples  are 
given  to  illustrate  the  technique. 

INTRODUCTION 

The  analysis  of  linear  systems  with  multiplicative  or  state  dependent 
noise  (i.e.  bilinear  stochastic  systems)  has  recently  attracted  a great 
deal  of  attention  [1-14],  In  particular,  the  stochastic  stability  of  such 
systems  for  which  the  noise  processes  are  Gaussian  has  been  studied  in  some 
detail.  In  this  paper  the  stochastic  stability  of  a class  of  linear 
systems  with  non-Gaussian  multiplicative  noise  is  analyzed.  The  particular 
noise  processes  considered  are  a form  of  filtered  Poisson  processes. 

Our  technique  for  investigating  stochastic  stability  is  based  upon  a 
method  used  by  Willsky,  Marcus,  and  Martin  [1].  In  the  following  sections 
we  describe  a technique  for  investigating  the  stochastic  stability  of  a 
class  of  systems.  The  technique  is  illustrated  with  examples. 

PRELIMINARIES 

We  are  interested  in  systems  of  the  form 


k ' 

x(t)  = A_  + £ A.f  (t)  x(t)  , 
i-1 


where  the  A^  are  known  nxn  matrices,  x(t)  is  an  n dimensional  vector,  and 


fx(t), 


, f^(t)  are  noise  processes.  We  assume  that  the  noise  processes 


are  independent  of  the  initial  condition  x(0) . 

A Lie  algebra  of  n*n  matrices  is  a subspace  of  nxn  matrices  that  is 
closed  under  the  commutator  product  [A,B]  A AB  - BA.  The  Lie  algebra 
generated  by  a set  of  nxn  matrices  is  the  smallest  Lie  algebra  containing 
that  set  of  matrices.  A Lie  algebra  is  said  to  be  solvable  if  and  only  if 
there  exists  a nonsingular  matrix  P (possibly  complex  valued)  such  that 

PAP-*  is  upper  triangular  for  every  A belonging  to  the  Lie  algebra  (see 
[1]).  Let  SB  denote  the  Lie  algebra  generated  by  Aq,  A^,  ...  , A^  and 

assume  that  SB  is  solvable. 

Let  p be  a positive  integer  and  let  x. (t)  denote  the  i component  of 

the  vector  x(t).  We  say  that  the  null  solution  of  (1)  is  p moment  asymp- 

totically stable  if,  for  all  initial  states  x(0)  possessing  the  desired 


moments  and  independent  of  f^(t). 


f^(t),  we  have 


11m  E j[Xl(t)]Pl  [X2(t)]P2  [Xn(t>]' 


for  V*1 
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for  any  set  of  nonnegative  integers  that  sum  to  p.  It  is  shown  in  [1] 

th 

that,  if  SB  is  solvable,  then  the  p moment  asymptotic  stability  of  (1)  is 
equivalent  to  the  first  moment  asymptotic  stability  of  another  system  of  the 
form  (1),  also  with  a solvable  Lie  algebra.  Therefore,  we  can  confine  our 
discussion  to  the  first  moment  asymptotic  stability  of  (1),  that  is 

lim  E jx^(t) | ■ 0 , i ■ 1,  ...  , n . 

t-*OS 

DEVELOPMENT 


We  write  the  solution  to  (1)  in  the  form 
x(t)  - *f(t,0)  x(0)  , 

where  *f(t,0)  is  the  transition  matrix  for  (1),  thought  of  as  an  explicit 
function  of  the  processes  f^t).  Since  SB  is  assumed  to  be  solvable,  we 

such  that 

The  equation 
, Y(0)  - I , 

where  Y(t)  is  an  n*n  matrix,  can  be  solved  by  straightforward  calculations. 
Thus  we  have  that 

$f(t,0)  - P"1  Y(t)  P , 

and  we  can  see  that  $^(t,0)  involves  nothing  more  complicated  than  exponen- 
tials of  integrals  of  the  f^(t),  polynomials  in  the  f (t),  and  various 

combinations,  products,  and  integrals  of  such  quantities.  This  was  the 
approach  used  in  [1],  where  it  was  assumed  that  the  f^(t)  were  mutually 

Gaussian  random  processes.  Using  the  properties  of  the  Gaussian  distribu- 
tion, it  was  then  possible  to  evaluate 

E |*f(t,0)|  . (2) 

Since  E{x(t)}  - E{*^(t,0)}  E{x(0)},  we  see  that  it  is  necessary  to  know  the 

quantity  in  (2)  in  order  to  investigate  the  first  moment  asymptotic 
stability  of  (1). 

In  this  paper  we  will  assume  that  the  noise  processes  f^(t),  ...  , f^(t) 

are  independent  random  processes  and  that  each  is  a type  of  filtered  Poisson 
process.  Specifically,  we  assume  that  a noise  process  has  the  following 
form: 

0 . »t-° 

f(t)  - { ijt  (3) 

/ Z>i»<t.v  • “t^1 

where  is  a Poisson  counting  process  with  intensity  function  A(t)  _>  0 , 


know  that  there  is  a nonsingular  matrix  P 

»t  ■ PAip'1 

is  upper  triangular  for  i*0,  1,  ...  , k. 


Y(t)  - 


Bo + E 


Y(t) 


11 


'TT  iT-: 


x^  is  the  i occurrence  time,  and  the  amplitudes  are  Independent  and 

identically  distributed  and  independent  of  Nt>  It  will  be  assumed  that 

X(t)  is  integrable  over  bounded  sets  and  positive  on  a set  of  positive 
Lebesque  measure.  Also,  it  is  assumed  that  possesses  a moment  generating 

function.  Finally,  it  is  assumed  that  the  impulse  response,  or  weighting 
function,  h(t,x)  is  causal;  that  is,  h(t,x)  - 0 for  t < t.  Noise  processes 
of  this  general  type  are  a popular  model  for  many  physical  phenomena. 

The  characteristic  functional  of  the  random  process  f(t)  defined  in 
(3)  is  given  by  the  following  [15]: 


Cf(g)  A E jexp  jj  f(s)  dg(s  >1)  » exp  (C  A(t)|*(J  h(s,T)  dg(s)j-ljdT^  , 

(4) 

where  *(a)  ■ E{exp(jaU^)}  is  the  characteristic  function  of  U^.  By  the 

proper  choice  of  the  function  g(*)»  we  can  use  the  characteristic  functional 
in  (4)  to  evaluate  (2).  We  now  illustrate  the  method  with  examples. 

Example  1:  Let  n ■ k ■ 2 , and  let 


A0“ 


-2  1 

-1  0 


A1  ‘ 


1 0 
1 0 


A2  " 


1 -1 

0 0 


In  this  case  we  can  easily  check  that  SB  is  solvable  and  that 

0 1 
1 -1 

upper  triangularlzes  the  system.  Letting  y • Px,  we  have 


P - 


y(t)  - 

Thus  we  find  that 

y(t)  - 


-l  + f1(t) 


»ll(t)  a12^ 

0 a22(t) 


-l  + f1(t) 


-l  + f2(t) 


y(0)  , 


y(t)  . 


where 


aii(t)  - exp 


-t  + 


r 


dx 


i-1.  2 


and 


a12(t^  “ / exp  -t  + J f1(t)dT+  J f2(x)dx  |-l  + f1(s)|ds 


Assume  that  both  of  the  noise  processes  have  the  form  of  (3)  and  that 
for  each  of  the  noise  processes  the  corresponding  amplitudes  {U^}  have  a 

Gaussian  distribution  with  zero  mean  and  unit  variance.  Let 
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h1(t,x)  - exp(x-t)  u(t  - x)  and  h2(t,x)  - u(t-x)  - u(t-x-l),  where  u(*) 

is  the  unit  step  function. 

Using  (4)  we  find  that 


Elaii(t)i  “ exP 


^-t  + f A±(x)  m(/  hi(8,x)  dsj-ljdx^ 


where  M(a)  » exp (a  / 2)  . Since 


M | j h± (8 f x)  dsj  < 


for  all  t,x. 


we  have  that 


E jaii(t)|  <_  exp  t + ( Ve-  - 1 ) f ^(x)  dx  j 


Therefore,  if 


or  if 


/; 


a1<t)  i 


dx  < oo 


K-i) 


for  some  a < 1 , 


then  we  see  that 


lim  E{a  (t)}  - 0 


Now  consider  the  off-diagonal  term: 
al2(t)  - - / exp£-t+  J f,(x)  dx  + jf  f2(x)dxjds 

(7) 

+ J fx(s)  exp£-t  + J fx(x)  dx  + j f f2(x)dxjds  . 

The  magnitude  of  the  expectation  of  the  first  summand  in  (7)  can  be  upper 
bounded  by 

t t -8 

J exp  -t+  (/T-  l)  / A1(x)  dx  + (Se-  l)  / *2(x)  dx  da  . (8) 

■'O  s 0 

Thus  we  see  that  if  and  A2  each  satisfy  either  (5)  or  (6)  then  (8)  goes 
to  zero  as  t approaches  Infinity. 

To  evaluate  the  expectation  of  the  second  summand  in  (7)  we  proceed 


- 5 - 


as  follows.  Using  (4)  we  find  chat 


|exp  |r  f^(s)  + J f xCt)  drj  ^ - exp  ^ J X^Cx)  (r  + 1 - eT_t)  -ljdx^  . 


Thus, 
E 


jf^s)  exp  ^ J f X(x)  dr  j ^ ~ E |exp  |r  f1(s)  + J f x (t)  drj  ^ J 

| / X1(q)  [M(l-eq"t)-l]dq|  / X^x)  ( 1 - eT_t)  m(i  - eT_t)  c 


exp 


Therefore, 


jf^(s)  exp  | j f^x)  dxj  j <_  JZ  J X^(x)dx  exp  [f  *x(q)  (Se  - l)  dqj 

' (9) 

If  X^  satisfies  (5),  then  (9)  can  be  upper  bounded  by  a constant.  If  X^ 

satisfies  (6),  then  (9)  can  be  upper  bounded  by  3(t-s)  expfa(t-s)]. 

Now  consider 

* {-*  [ I0  f2<T)<lT]|- 

This  can  be  upper  bounded  by 

exp  [k-o/;  X2(t)  dx  j . 

If  X2  satisfies  (S)  or  (6),  this  can  be  upper  bounded  by  a constant  times 

exp  (as).  Therefore,  if  and  X^  each  satisfy  either  (5)  or  (6),  then 

E{a^2(t)}  goes  to  zero  as  t approaches  infinity,  and  we  conclude  that  the 

system  of  Example  1 is  asymptotically  stable. 

Example  2:  Consider  the  following  scalar  equation: 


x(t)  - a x(t)  + $ x(t)  f(t) 
where  0 + 0.  The  solution  is  given  by 


(10) 


x(t)  - x(0)  exp 


a t + 0 


f f(x)  dr 


Assume  that  f(t)  is  a compound  Poisson  process;  that  is,  in  (3), 
h(t,x)  ■ u(t-x).  Then,  using  (4),  we  have  that 

E | exp  | 0 J f(t)  dtj  | - exp  X(x)  | M ^0  (t-x)J  -lj  dx^ 
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where  M is  the  moment  generating  function  of  0 . It  is  straightforward  to 
show  that  if  P{0U^  > 0}  > 0 then  there  exists  a y > 0 such  that  for 

t > x,  M[0(t  - x)  ] _>  exp[y(t  - x)  ] . Assuming  that  P{0U.  > 0}  > 0,  we  have 
that  1 

e|bxp|0  J f(x)  dxj|  _>  exp  [C  A(x)  ^exp  Jy(t  - x)j  - 1^  dx  j . 


Notice  that 


A(x)  ^exp  |y(t  - x)J  - lj  dx^  - y eYt  J A(x) 


Since  A(*)  is  positive  on  a set  of  positive  Lebesque  measure,  we  see  that 
(11)  approaches  infinity  as  t approaches  infinity.  This  yields  the 
following  result. 

Theorem:  Assume  that  f(t)  is  a compound  Poisson  process  whose  amplitudes 
possess  a moment  generating  function  and  that  the  intensity  function 

A(*)  is  positive  on  a set  of  positive  Lebesque  measure.  Also,  assume  that 

P{0U^  > 0}  > 0 . Then  (10)  is  not  asymptotically  stable. 

Notice  that  if  the  support  of  the  distribution  of  includes  both 

positive  and  negative  numbers,  then  P{0  > 0}  > 0 . 

Example  3:  Now  consider  the  following  ntl1  order  system: 

x(t)  - Aq  x(t)  + Ax  x(t)  f(t)  (12) 

where  An  and  A.,  are  upper  triangular  n*n  matrices  and  x(t)  is  an  n 
dimensional  vector.  Notice  that  the  ifc  term  of  the  diagonal  of  the 
transition  matrix  $^(t,0)  will  be  of  the  form 


a,  t + 0 / f (x)  dx  , 

1 1 Jo 


where  and  0^  are  the  i**1  terms  of  the  diagonals  of  Aq  and  A^, 
respectively.  If  the  Initial  state  x(0)  is  a constant  vector  with  a one 
in  the  i^  position  and  zeros  elsewhere,  then  the  iC^  component  of  x(t) 
will  be  given  by  (13).  This  results  in  the  following  corollary. 

Corollary:  If  at  least  one  diagonal  element  0 of  A^  is  nonzero  and  if 
f(t)  satisfies  the  conditions  of  the  Theorem,  then  (12)  is  not  asymptotl- 

» 


cally  stable. 
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Example  4:  Consider  the  system  (10)  and  let  the  noise  process  be 
given  by  (3)  where 


h(t,x)  - exp  y(t  - t)j  u(t-x)  , y > 0 . 

Let  M(*)  be  the  moment  generating  function  of  U . We  find  that 


• 

E ■ 

exp 

6 f f (x)  dx 

> - exp 

/ *(x)  (m  (l  - exp  [-Y(t  - x)]  i|-l^dx 

l 

. o 

) 

0 \ LY  v L J/J  / 

Assuming  that  !(•)  is  integrable,  we  see  that  this  quantity  can  be  easily 
upper  bounded.  In  this  case  we  see  that  (10)  is  asymptotically  stable  if 
a < 0. 

Example  5;  Consider  the  scalar  equation  (10).  Let  f(t)  be  given  by 
(3)  and  assume  that  h is  a function  of  the  difference  of  its  arguments,  say 

h(t,t)  - h(t-x)  . 


Assume  that  possesses  the  moment  generating  function  M(*).  Also, 
assume  that 


f I MO| 


dt  < ® 


(14) 


Then  from  (4)  we  see  that 

f (x)  dxll  - exp 


E jexp  0 jf  f(x)  dxjj  - exp  j f A(x)  Je  ii(s)  dsj  - 1^  dx 


From  (14)  we  conclude  that 


! 

Thus  we  see  that  if  o < 0 , the  system  is  asymptotically  stable. 


CONCLUSIONS 

We  have  presented  a method  for  analyzing  the  p^  moment  asymptotic 
stability  of  a class  of  linear  systems  with  multiplicative  state  noise. 
The  class  of  systems  considered  were  required  to  satisfy  a certain  Lie 
algebraic  condition.  The  noise  processes  were  taken  to  be  a form  of 
filtered  Poisson  noise.  The  utility  of  the  method  was  illustrated  with 
several  examples.  We  note  that  these  methods  can  be  extended  in  a 
straightforward  fashion  to  Include  noise  processes  having  the  form 
considered  in  this  paper  plus  an  additive  Independent  Gaussian  component. 
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